Method for synthesizing image and an electronic device using the same

ABSTRACT

An apparatus and method for synthesizing an image and an electronic apparatus using the method are provided. The electronic apparatus includes a memory that stores pictures, a transceiver that communicates with an external server, a display that detects a user interaction, and a processor that reads pictures from the memory. The processor first selects pictures based on a weighted value, determines first attribute information and second attribute information from the first selected pictures, stores the first attribute information and the second attribute information in a database form, second selects at least one picture from among the first selected pictures based on the first attribute information, the second attribute information and user context information, controls the transceiver to receive a product image corresponding to the second selected picture from the external server, and creates a composite image by synthesizing the second selected picture and the product image.

CROSS-REFERENCE TO RELATED APPLICATION(S)

This application claims the benefit under 35 U.S.C. § 119(a) of a Koreanpatent application filed on Apr. 1, 2016 in the Korean IntellectualProperty Office and assigned Serial number 10-2016-0040268, the entiredisclosure of which is hereby incorporated by reference.

TECHNICAL FIELD

The present disclosure relates to a method and system for providing avirtual clothes wearing service. More particularly, the presentdisclosure relates to an electronic apparatus to synthesize a pictureincluding a user with a product image and provide the synthesized imageto a user terminal apparatus or a large flat display (LFD).

BACKGROUND

Advancement of computer and communication technology has enabled anelectronic apparatus to have a small size and include various functions.In particular, the electronic apparatus may have a camera to create animage, and transmit the created image to a server in a remote placethrough a wireless communication function.

Meanwhile, a user may use various purchasing methods to purchase aproduct such as clothing or accessories via offline or online. By usingsuch methods, the user makes a decision to purchase clothes oraccessories by looking at a product worn by another entity, such as anAvatar, or a model, etc. In this case, the user is confronted with anunexpected result, and it is inconvenient for the user that he or shecannot wear the actual clothes and accessories. Also, user purchasedclothes and accessories may not fit changed season and environment,bringing about various problems.

The above information is presented as background information only toassist with an understanding of the present disclosure. No determinationhas been made, and no assertion is made, as to whether any of the abovemight be applicable as prior art with regard to the present disclosure.

SUMMARY

Aspects of the present disclosure are to address at least theabove-mentioned problems and/or disadvantages and to provide at leastthe advantages described below. Accordingly, an aspect the presentdisclosure is to provide a method and apparatus for generating an imagein which a user selects a picture from among the previously-takenpictures and the selected picture is synthesized with clothes oraccessories to be purchased by the user, and providing the same.

In accordance with an aspect of the present disclosure, a method forgenerating a composite image of an electronic apparatus is provided. Themethod includes first selecting at least one picture based on a weightedvalue, determining first attribute information and second attributeinformation based on the first selected at least one picture, storingthe first attribute information and the second attribute information ina database form, second selecting at least one picture from among thefirst selected at least one picture based on the first attributeinformation, the second attribute information and user contextinformation, receiving a product image corresponding to the secondselected at least one picture from a server, and generating a compositeimage by synthesizing the second selected at least one picture with theproduct image. The weighted value may be determined based on a dateand/or time on which a picture is created. Alternatively, the weightedvalue is determined based on a shape of an object included in thepicture. Alternatively, the weighted value may be determined based onwhether a picture is shared. Alternatively, the weighted value may bedetermined based on a user interaction. The user interaction may bedetected while a picture is displayed on a screen. The weighted valuemay be increased in response to the user interaction being a zoom-ingesture. The first attribute information may be information on an objectincluded in a picture. The second attribute information may beinformation on a background of a picture. The user context informationmay include position information of a user.

In accordance with another aspect of the present disclosure, anelectronic apparatus is provided. The electronic apparatus includes amemory configured to store a plurality of pictures, a transceiver thatcommunicates with an external server, a display that detects a userinteraction, and a processor that is configured to read pictures fromthe memory. The processor is further configured to first select at leastone picture based on a weighted value, determine first attributeinformation and second attribute information from the first selected atleast one picture, store the first attribute information and the secondattribute information in a database form, second select at least onepicture from among the first selected at least one picture based on thefirst attribute information, the second attribute information and usercontext information, control the transceiver to receive a product imagecorresponding to the second selected picture from the external server,and create a composite image by synthesizing the second selected atleast one picture and the product image. The weighted value may bedetermined based on a date and/or time on which a picture among theplurality of pictures was created. The weighted value may be determinedbased on a shape of an object included in a picture. The weighted valuemay be determined based on whether a picture is shared. The weightedvalue may be determined based on a user interaction. The userinteraction may be detected while a picture is displayed on a screen.The electronic apparatus may increase the weighted value in response tothe user interaction being a zoom-in gesture. The first attributeinformation may be information on an object included in a picture. Thesecond attribute information may be information on a background of apicture. The user context information may include position informationof a user.

In accordance with another aspect of the present disclosure, anelectronic apparatus is provided. The electronic apparatus includes amemory configured to store a plurality of pictures, a display thatdetects a user interaction, and a processor. The electronic apparatusreads the plurality of pictures from the memory, first selects at leastone picture based on a weighted value, determines first attributeinformation and second attribute information from the first selected atleast one picture, stores the first attribute information and the secondattribute information in a database form, second selects at least onepicture from among the first selected at least one picture based on thefirst attribute information, the second attribute information and usercontext information, controls the transceiver to receive a product imagecorresponding to the second selected at least one picture from a server,and creates a composite image by synthesizing the second selected atleast one picture with the product image, thereby enabling the user tosee or visualize himself or herself wearing the actual product.

In accordance with another aspect of the present disclosure, anapparatus for synthesizing an image is provided. The apparatus includesa display, at least one processor, and at least one memory storing oneor more computer programs configured to be executed by the at least oneprocessor. The one or more computer programs including instructions for,first selecting at least one picture among a plurality of pictures basedon a weighted value, determining first attribute information and secondattribute information from the first selected at least one picture,second selecting at least one picture among the first selected at leastone picture based on at least one of the first attribute information,the second attribute information and user context information,controlling the transceiver to receive a product image corresponding tothe second selected at least one picture from an external server, andcreating a composite image by synthesizing the second selected at leastone picture and the product image.

Other aspects, advantages, and salient features of the disclosure willbecome apparent to those skilled in the art from the following detaileddescription, which, taken in conjunction with the annexed drawings,discloses various embodiments of the present disclosure.

BRIEF DESCRIPTION OF THE DRAWINGS

The above and other aspects, features, and advantages of certainembodiments of the present disclosure will be more apparent from thefollowing description taken in conjunction with the accompanyingdrawings, in which:

FIG. 1 is a view illustrating a network environment including anelectronic apparatus, according to various embodiments of the presentdisclosure;

FIG. 2 is a block diagram of an electronic apparatus, according tovarious embodiments of the present disclosure;

FIG. 3 is a rough flowchart of the present disclosure according tovarious embodiments of the present disclosure;

FIG. 4 is a view explaining a process of selecting a plurality ofpictures stored in the electronic apparatus according to variousembodiments of the present disclosure;

FIG. 5 is a view explaining a process of selecting, by an electronicapparatus, a picture received from a server according to variousembodiments of the present disclosure;

FIG. 6 is a flowchart of a method of assigning a weighted value withrespect to a picture created by a user according to various embodimentsof the present disclosure;

FIG. 7 is a flowchart of a method of assigning a weighted value withrespect to a picture received from a server according to variousembodiments of the present disclosure;

FIG. 8 is a view illustrating an example of extracting, from a selectedpicture, attribute information of clothes included in the picture andattribute information of a background of the picture according tovarious embodiments of the present disclosure;

FIGS. 9A and 9B are views illustrating an example of recommending a userpreferred clothes using attribute information of a picture according tovarious embodiments of the present disclosure;

FIG. 10 is a view provided to explain an example of synthesizing a usercreated picture with a product image provided by a third party andproviding the same according to various embodiments of the presentdisclosure;

FIG. 11 is a view provided to explain a process of synthesizing aproduct image with a picture for fitting use stored in an electronicapparatus according to various embodiments of the present disclosure;and

FIG. 12 is a flowchart provided to explain a process of synthesizing aproduct image with a picture for fitting use in an electronic apparatus,according to various embodiments of the present disclosure.

Throughout the drawings, it should be noted that like reference numbersare used to depict the same or similar elements, features, andstructures.

DETAILED DESCRIPTION

The following description with reference to the accompanying drawings isprovided to assist in a comprehensive understanding of variousembodiments of the present disclosure as defined by the claims and theirequivalents. It includes various specific details to assist in thatunderstanding but these are to be regarded as merely exemplary.Accordingly, those of ordinary skill in the art will recognize thatvarious changes and modifications of the various embodiments describedherein can be made without departing from the scope and spirit of thepresent disclosure. In addition, descriptions of well-known functionsand constructions may be omitted for clarity and conciseness.

The terms and words used in the following description and claims are notlimited to the bibliographical meanings, but, are merely used by theinventor to enable a clear and consistent understanding of the presentdisclosure. Accordingly, it should be apparent to those skilled in theart that the following description of various embodiments of the presentdisclosure is provided for illustration purpose only and not for thepurpose of limiting the present disclosure as defined by the appendedclaims and their equivalents.

It is to be understood that the singular forms “a,” “an,” and “the”include plural referents unless the context clearly dictates otherwise.Thus, for example, reference to “a component surface” includes referenceto one or more of such surfaces.

In the present disclosure, the expressions such as “have”, “may have”,“include” or “may include” refer to the presence of the correspondingfeature (for example, components such as numerical value, function,operation or part, etc.), and do not exclude the presence of additionalfeatures.

In the present disclosure, the expressions such as “A or B”, “at leastone of A and/or B” or “one or more of A and/or B” may include allpossible combinations of the listed items. For example, “A or B”, “atleast one of A and B” or “at least one of A or B” may refer to all of(1) at least one A, (2) at least one B or (3) both at least one A and atleast one B.

The expressions “the first”, “the second” “first” and “second” used inthe present disclosure may modify various elements, regardless of theorder and/or the significance, and are only used to distinguish oneelement from another, and do not limit the corresponding elements. Forexample, a first user apparatus and a second user apparatus mayrepresent different user apparatuses, regardless of the order or thesignificance. For example, a first element may be named a secondelement, and similarly, the second element may be named the firstelement, while not extending beyond the scope of the present disclosure.

When it is mentioned that an element (e.g. a first element) is“operatively or communicatively coupled with/to” or “connected to”another element (e.g. a second element), it shall be understood that theone element may be directly coupled with the other element, or may becoupled via another element (e.g. a third element). On the other hand,when it is mentioned that one element (e.g. a first element) is“directly coupled with/to” or “directly connected to” another element(e.g. a second element), it may be understood that no element (e.g. athird element) is present between the one element and another element.

The expression “configured to” used in the present disclosure may,depending on the situation, be interchangeably used as, for example,“suitable for”, “having the capacity to”, “designed to”, “adapted to”,“made to” or “capable of”. The expression “configured to” does notnecessarily mean “specifically designed to” in hardware wise. Instead,in some situations, the expression “apparatus configured to” may meanthat the apparatus may be “configured to” do something with anotherapparatus or parts. For example, the phrase “a processor configured toperform A, b, and C” may refer to an exclusive processor (e.g. embeddedprocessor) for performing the corresponding operations, or ageneric-purpose processor (e.g. central processing unit (CPU) orapplication processor (AP)) for performing the corresponding operationsby executing at least one software program stored in a memory apparatus.

The terms used in the present disclosure are used to explain anarbitrary embodiment, and may not intend to limit the scope of anotherembodiment. In addition, in the present specification, a singularexpression may be used for convenience of explanation, but unless theexpression has an obvious different meaning in the context, it may beunderstood as a concept that includes plural expressions as well. Inaddition, the terms used in the present specification may have a samemeaning with what is commonly understood by those skilled in the art.The terms defined in a general dictionary of all the terms used in thepresent specification may be understood to have a same or similarmeaning with the meaning in the context of the related art, and unless aterm is specifically defined in the present specification, the term isnot to be understood to have a meaning that is ideal or excessivelyperfunctory. Depending on the situation, even if a term is defined inthe present specification, it may not be understood to excludeembodiments of the present specification.

The electronic apparatus according to various embodiments of the presentdisclosure may, for example, include at least one of a smartphone, atablet personal computer (PC), an e-book reader, a desktop personalcomputer (PC), a laptop PC, a netbook computer, a workstation, and aserver. In some embodiments, an electronic apparatus may be a homeappliance. The home appliances may, for example, include at least one ofa television, a TV box (e.g. Samsung HomeSync™, Apple TV™, or GoogleTV™), and an electronic frame.

According to an embodiment, an electronic apparatus may include at leastone of an electronic board, an electronic signature receiving device,and a projector. In various embodiments, an electronic apparatus may beone of the aforementioned various devices or a combination thereof. Anelectronic apparatus according to some embodiment may be a flexibleelectronic apparatus. Also, an electronic apparatus according toembodiments of the present disclosure is not limited to theabove-mentioned devices, and may include a new electronic apparatusaccording to development of a new technology.

Hereinafter, an electronic apparatus according to various embodimentswill be described with reference to the accompanying drawings. In thepresent disclosure, the term “user” may refer to a person who uses anelectronic apparatus or an apparatus (e.g. artificial intelligenceelectronic apparatus) that uses an electronic apparatus.

FIG. 1 is a view illustrating a network environment 100 including anelectronic apparatus, according to various embodiments of the presentdisclosure.

Referring to FIG. 1, an electronic apparatus 101 in a networkenvironment 100 according to various embodiments will be described withreference to FIG. 1. The electronic apparatus 101 may include a bus 110,a processor 120, a memory 130, an input/output interface 150, a display160, and a transceiver or communication interface 170. In someembodiments, the electronic apparatus 101 may omit at least one of theelements, or further include another element.

The bus 110 may, for example, include a circuit which connects elements110-170 with one another, and delivers communication (e.g. controlmessage and/or data) between the elements.

The memory 130 may include a volatile and/or non-volatile memory. Thememory 130 may, for example store a command related to at least oneother element of the electronic apparatus 101, or data. According to anembodiment, the memory 130 may store software and/or a program 140. Theprogram 140 may, for example, include a kernel 141, a middleware 143, anapplication programming interface (API) 145, and/or an applicationprogram (or “application”) 147, etc.

At least part of the kernel 141, the middleware 140, or the API 145 maybe referred to as an operating system (OS).

The kernel 141 may, for example, control or manage system resources 9e.g. the bus 110, the processor 120, or the memory 130, etc.) used forexecuting an operation or function realized in other programs (e.g. themiddleware 143, the API 145, or the application program 147). The kernel141 may provide an interface capable of controlling or managing systemresources by accessing individual elements of the electronic apparatus101 from the middleware 143, the API 145, or the application program147.

The middleware 143 may, for example, act as an intermediary so that theAPI 145 and the application program 147 could communicate and exchangedata with the kernel 141.

The middleware may process one or more operation requests received fromthe application program 147 according to a priority. For example, themiddleware 143 may assign at least one of the application programs 147 apriority to use a system resource (e.g. bus 110, processor 120, ormemory 130, etc.) of the electronic apparatus 101. For example, themiddleware 143 perform scheduling or load balancing, etc. with respectto the one or more operation requests by processing the at least oneoperation requests according to the assigned priority.

As illustrated in FIG. 1, the API 145 is, for example, an interface tocontrol, by the application 147, functions provided by the kernel 141 orthe middleware 143, which may include at least one interface or function(e.g. instruction) for file control, window control, image processing,or character control, etc.

The input/output interface 150 may, for example, play a role of aninterface capable of conveying a command or data input from a user oranother external apparatus to another element(s) of the electronicapparatus 101. The input/output interface 150 may output the command ordata received from another element(s) of the electronic apparatus 101 toa user or another external apparatus.

The display 160 may, for example, include a liquid crystal display(LCD), a light-emitting diode (LED) display, an organic light-emittingdiode (OLED) display, a microelectromechanical systems (MEMS) display,or an electronic paper display. The display 160 may, for example,display various contents (e.g. text, image, video, icon, or symbol,etc.) to a user. The display 160 may include a touch screen, and may,for example, receive a touch input using an electronic pen or using abody part of a user, a gesture, a proximity, or hovering.

The communication interface 170 may, for example, set a communicationbetween the electronic apparatus 101 and an external apparatus (e.g. afirst external electronic apparatus 102, a second external electronicapparatus 104 or a server 106). For example, as illustrated in FIG. 1,the communication interface 170 may be connected to a network 162 via awireless communication or a wired communication to communicate with anexternal apparatus (e.g. the second external electronic apparatus 104 orthe server 106).

A wireless communication is, for example, a cellular communicationprotocol, which may, for example, use at least one of a long-termevolution (LTE), a LTE advance (LTE-A), a code division multiple access(CDMA), a wideband CDMA (WCDMA), a universal mobile telecommunicationssystem (UNITS), a wireless broadband (WiBro), and a global system formobile communications (GSM), etc. The wireless communication may, forexample, include a near field communication (NFC) 164. The NFC 164 may,for example, include at least one of wireless fidelity (WiFi),Bluetooth, NFC, or global navigation satellite system (GNSS), etc. TheGNSS may include at least one of a global positioning system (GPS), aglobal navigation satellite system (Glonass), a Beidou Navigationsatellite system (hereinafter, “Beidou”) and Galileo, and the Europeanglobal satellite-based navigation system, according to a region of useor bandwidth, etc. In the present disclosure, the “GPS” may beinterchangeably used with “GNSS”. A wired communication may, forexample, include at least one of universal serial bus (USB), highdefinition multimedia interface (HDMI), recommended standard 232(RS-232), and plain old telephone service (POTS). The network 162 may,for example, include a telecommunications network, a computer network(e.g. local area network (LAN) or wide area network (WAN)), theInternet, or a telephone network.

The processor 120, as illustrated in FIG. 1, may include at least one ofa central processing unit (CPU), an application processor (AP), and acommunication processor (CP). The processor 120 may, for example,execute calculation or data processing regarding control and/orcommunication of at least one other element of the electronic apparatus101.

In particular, the processor 120, as illustrated in FIG. 1, may readpictures from the memory 130, first select pictures based on a weightedvalue, determine first attribute information and second attributeinformation from the first selected pictures, store the first attributeinformation and the second attribute information in a database form,second select at least one picture from the first selected picturesbased on the first attribute information, the second attributeinformation and user context information, control the communicationinterface 170 to receive a product image corresponding to the secondselected picture, and create a composite image by synthesizing thesecond selected picture and the product image.

Specifically, the processor 120 may first select pictures based on aweighted value at operation S1201, as illustrated in the flowchart ofFIG. 12. The weighted value may be determined based on a date and/ortime on which a picture is created. The processor 120 may compare dateand/or time information included in a picture with today's date orpresent time, and as a result of comparison, when the date and/or timeon which the picture is created is older than a predetermined period,determine that the picture is an old picture and lower the weightedvalue of the picture (e.g., according to the difference in time). Inaddition, the processor 120 may also determine a weighted value based ona shape of an object included in the picture. The object included in thepicture may be a user, and the shape of the object may be divided into afront side, a lateral side, and a rear side. The processor 120 mayanalyze the picture, and determine whether the shape of the object is afront side, lateral side, or a rear side. The processor 120 may increasea weighted value of the picture when it is determined that the object ofthe picture is a front side. The processor 120 may further determine aweighted value based on whether a picture is shared. When a user sharesa picture, shared information may be stored in the picture. The sharedinformation may include a date and/or time on which the picture wasshared, an address at which the picture was shared, and the name of theapplication that was used for sharing. The processor 120 may furtherdetermine whether a picture is shared by extracting sharing informationfrom the picture, and increase a weighted value of the shared picture.The processor 120 may determine a weighted value based on a userinteraction. After a user creates a picture, and then performs a zoom-inor zoom-out operation with respect to a picture or flicks the picturewhile reproducing the picture, user interaction information may bestored in the picture. The processor 120 may extract user interactioninformation from a picture stored in the memory 130, and determine aweighted value of the picture accordingly. For example, the processor120 may control the display 160 to display a picture on a screen, andwhen a user performs a zoom-in gesture, detect the user interaction andstore the detected user interaction in the picture. When the userinteraction is a zoom-in gesture, a weighted value of the picture may beincreased. The processor 120 may first select pictures of which aweighted value calculated using the above-mentioned method exceeds apredetermined value, and use the selected pictures for fitting use.

The processor 120, illustrated in FIG. 1, may determine first attributeinformation and second attribute information from the first selected oneor more pictures. In this example, the first attribute information maybe information on an object included in a picture. The object may be auser or clothes worn by the user. The processor 120 may recognize a userby analyzing the picture, extract a style, color, brand, size and otherinformation of clothes worn by the user, and store the extractedinformation in the memory 130 as information on the object. Theattribute information on a background may include a position of thebackground of a picture, weather, season or context, etc. The processor120 may store the first attribute information and the second attributeinformation in the memory 130 in a database form. The first attributeinformation and the second attribute information may be structured,categorized and stored.

The processor 120, illustrated in FIG. 1, may second select at least onepicture from the first selected one or more pictures based on the firstattribute information, the second attribute information and user contextinformation. The user context information may include positioninformation of the user. The user context information may includeinformation on an operational state of the user. For example, thecontext information may indicate whether the user is shopping, sleeping,going to work or eating.

The processor 120 may control the communication interface 170 to receivea product image corresponding to the second selected picture from theserver 106. The second selected picture may be used to create acomposite image. The product image may, for example, be an image ofclothes provided by a third party. The product image may be selectedbased on information on a picture for fitting use provided by theelectronic apparatus 101. The processor 120 may, when a user is locatedin a particular place or performs a particular action, select a picturefor fitting use corresponding to the user context, and provide attributeinformation of the picture for fitting use to the server 106 or thedisplay apparatus 102.

The processor 120 may synthesize the second selected picture with theproduct image to create a composite image. In this example, theprocessor 120 may create a composite image, but this is merely anexample, and an external server 106 or the display apparatus 102 maycreate a composite image.

The processor 120 may control the display 160 to display the compositeimage. In this example, the processor 120 may control the display 160 todisplay the product image together with the composite image.

The external electronic apparatus 104, illustrated in FIG. 1, may be anapparatus of the same or different type as the electronic apparatus 101.According to an embodiment, the server 106 may include a group of one ormore servers. According to various embodiments, all or some ofoperations executed in the electronic apparatus 101 may be executed inanother electronic apparatus or a plurality of electronic apparatuses(e.g. electronic apparatus 104 or server 106). According to anembodiment, when the electronic apparatus 101 is to perform a functionor a service automatically or per request, the electronic apparatus 101may request another apparatus (e.g. electronic apparatus 104 or server106) to perform at least some of the functions related to the functionor service either additionally or instead of executing the function orservice by itself. Another electronic apparatus (e.g. electronicapparatus 104 or server 106) may execute the requested function oradditional function, and transmit the result to the electronic apparatus101. The electronic apparatus 101 may process the received result as itis or additionally process the received result to provide the requestedfunction or service. To that end, for example, a cloud computing,distributed computing or client-server computing technology may be used.

The display apparatus 102 may, for example, be a large flat display(LFD). The LFD may communicate with the electronic apparatus 101 via thecommunication interface 170 of the electronic apparatus 101. The displayapparatus 102 may communicate with the server 106 via the network 162.

FIG. 2 is a block diagram of an electronic apparatus, according tovarious embodiments of the present disclosure.

Referring to FIG. 2, the electronic apparatus 201 may, for example,include all or some of the components of the electronic apparatus 101illustrated in FIG. 1. The electronic apparatus 201 may include at leastone processor 210 (e.g. AP), a communication module 220, a subscriberidentification module (SIM) 224, a memory 230, a sensor module 240, aninput apparatus 250, a display 260, an interface 270, an audio module280, a camera module 291, a power management module 295, a battery 296,an indicator 297, and a motor 298.

The processor 210 may, for example, control a number of hardware orsoftware elements connected to the processor 210 by driving an operatingsystem or application program, and perform various data processing andcalculations. The processor 210 may, for example, be realized as asystem on chip (SoC). According to an embodiment, the processor 210 mayfurther include a graphic processing unit (GPU) and/or an image signalprocessor (ISP). The processor 210 may also include at least some (e.g.cellular module 221) of the elements illustrated in FIG. 2. Theprocessor 210 may load a command or data received from at least one ofother elements, such as non-volatile memory to a volatile memory toprocess it, and store various data in the non-volatile memory.

The communication module 220 may have a configuration that is the sameas or similar to the communication interface 170 of FIG. 1. Thecommunication module 220 may, for example, include a cellular module221, a WiFi module 223, a Bluetooth (BT) module 225, a GNSS module 227(e.g. GPS module, Glonass module, Beidou module, or Galileo module), anear field communication (NFC) module 228, and a radio frequency (RF)module 229.

The cellular module 221 may, for example, provide a voice call, a videocall, a text messaging service, or an Internet service via acommunication network. According to an embodiment, the cellular module221 may perform identification and authentication of the electronicapparatus 201 within a communication network using the SIM (e.g. SIMcard)) 224. According to an embodiment, the cellular module 221 mayperform at least some of the functions providable by the processor 210.According to an embodiment, the cellular module 221 may include a CP.The WiFi module 223, the Bluetooth module 225, the GNSS module 227 orthe NFC module 228 may, for example, include a processor to process datatransmitted or received through the corresponding module, respectively.According to an embodiment, at least some (e.g. at least two) of thecellular module 221, the WiFi module 223, the Bluetooth module 225, theGNSS module 227, or the NFC module 228 may be included in one integratedchip (IC) or IC package.

The RF module 229 may, for example, transmit or receive a communicationsignal (e.g. RF signal). The RF module 229 may, for example, include atransceiver, a power amp module (PAM), a frequency filter, a low noiseamplifier (LNA), or an antenna, etc. According to another embodiment, atleast one of the cellular module 221, the WiFi module 223, the Bluetoothmodule 225, the GNSS module 227 and the NFC module 228 may transmit orreceive an RF signal through a separate RF module.

Referring to FIG. 2, the subscriber identification module 224 may, forexample, include a card or an embedded SIM including a subscribeidentification module, and include a unique identification information(e.g. integrated circuit card identifier (ICCID)) or subscriberinformation (e.g. international mobile subscriber identity (IMSI)).

The memory 230 may, for example, include an embedded or internal memory232 or an external memory 234. The embedded or internal memory 232 may,for example, include at least one of a volatile memory (e.g. dynamicrandom access memory (DRAM)), a static RAM, a synchronous dynamic RAM, anon-volatile memory (e.g. onetime programmable read only memory(OTPROM)), a programmable ROM (PROM), an erasable and programmable ROM(EPROM), an electrically erasable and programmable ROM (EEPROM), a maskROM, a flash ROM, a flash memory (e.g. NAND flash or NOR flash, etc.), ahard drive, and a solid state drive (SSD).

The external memory 234 may further include a flash drive, such as acompact flash (CF), a secure digital (SD), a micro secure digital(micro-SD), a mini-SD, an extreme digital (xD), a multimedia card (MMC),or a memory stick. The external memory 234 may be connected to theelectronic apparatus 201 functionally and/or physically through variousinterfaces.

The sensor module 240 may, for example, may measure a physical quantityor detect an operational state of the electronic apparatus 201, andconvert the measured or detected information into an electrical signal.The sensor module 240 may, for example, include a gesture sensor 240A, agyro sensor 240B, a barometer or air pressure sensor 240C, a magneticsensor 240D, an acceleration sensor 240E, a grip sensor 240F, aproximity sensor 240G, a color sensor 240H (e.g. red, green, blue (RGB)sensor), a medical or BIO sensor 240I, a temperature/humidity sensor240J, an illuminance or luminous intensity sensor 240K, and anultraviolet (UV) sensor 240M, and an ultrasonic sensor 240N.Additionally or alternatively, the sensor module 240 may, for example,include an electronic nose (E-nose) sensor (not shown), anelectromyography (EMG) sensor (not shown), an electroencephalogram (EEG)sensor (not shown), an electrocardiogram (ECG) sensor (not shown), aninfrared (IR) sensor (not shown), an iris scan sensor (not shown),and/or a finger scan sensor (not shown). The sensor module 240 mayfurther include a control circuit to control at least one sensorincluded therein. According to an embodiment, the electronic apparatus201 may further include a processor configured to control the sensormodule 240 as part of the processor 210 or additionally, and control thesensor module 240 while the processor 210 is in a sleeping state.

As illustrated in FIG. 2, the electronic apparatus 250 may, for example,include a touch panel 252, a digital stylus or (digital) pen sensor 254,a key 256, or an ultrasonic input apparatus 258. The touch panel 252may, for example, use at least one of electrostatic type, pressuresensitive type, IR type, and a UV type. The touch panel 252 may furtherinclude a control circuit. The touch panel 252 may further include atactile layer to provide a tactile response to a user.

The (digital) pen sensor 254 may, for example, be part of a touch panelor include an additional sheet for recognizing use. The key 256 may, forexample, include a physical button, an optical key, or a keypad. Theultrasonic input apparatus 258 may detect ultrasonic sound(s) created byan input tool through a microphone (e.g. microphone 288), and check datacorresponding to the detected ultrasonic sound(s).

The display 260 may include a panel 262, a hologram apparatus 264 and/ora projector 266. The panel 262 may include a configuration that is thesame as or similar to a configuration of the display 160 of FIG. 1. Thepanel 262 may, for example, be realized to be flexible, transparent orwearable. The panel 262 may be configured as one module together withthe touch panel 252. The hologram apparatus 264 can display astereoscopic image in the air using interference of light. The projector266 may project light onto a screen to display an image. The screen may,for example, be located within or outside the electronic apparatus 201.According to an embodiment, the display 260 may further include acontrol circuit which controls the panel 262, the hologram apparatus264, or the projector 266.

The interface 270 may, for example, include an HDMI 272, a USB 274, anoptical interface 276 or a D-subminiature (D-sub) 278. The interface 270may, for example, be included in the communication interface 170illustrated in FIG. 1. Additionally or alternatively, the interface 270may, for example, include a mobile high-definition link (MHL) interface,a secure digital (SD) card/multi-media card (MMC) interface, or aninfrared data association (IrDA) standard interface.

The audio module 280 may, for example, convert a sound into anelectrical signal, and an electrical signal into a sound. At least someelements of the audio module 280 may, for example, be included in theinput/output interface 150 illustrated in FIG. 1. The audio module 280may process sound information input or output through a speaker 282, areceiver 284, earphones 286, or the microphone 288, etc., as illustratedin FIG. 2.

The camera module 291 is, for example, an apparatus which captures astill image and a video, and according to an embodiment, include atleast one image sensor (e.g. front sensor or rear sensor), a lens, anISP, or a flash (e.g. LED or xenon lamp, etc.).

The power management module 295 may, for example, manage power of theelectronic apparatus 201. According to an embodiment, the powermanagement module 295 may include a power management integrated circuit(PMIC), a charger IC, a gauge for battery 296, or a fuel gauge. The PMICmay use a wired and/or wireless charging method. The wireless chargingmethod may, for example, include a magnetic resonance method, anelectromagnetic inductive method, an electromagnetic method, or etc.,and further include, for example, a coil loop, a resonance circuit, arectifier, or etc. The battery gauge may, for example, measure aresidual amount of the battery 296, and a voltage, current, ortemperature while charging. The battery 296 may, for example, include arechargeable battery and/or a solar battery.

The indicator 297, as illustrated in FIG. 2, may display a particularstate, for example, a booting state, a messaging state, a chargingstate, or etc., of the electronic apparatus 201 or of part of theelectronic apparatus 201 (e.g. processor 210). The motor 298 may convertan electrical signal into a mechanical vibration, and create vibration,haptic effect, or etc. Although not illustrated, the electronicapparatus 201 may include a processing apparatus (e.g. GPU) forsupporting a mobile TV. The processing apparatus for supporting a mobileTV may, for example, process media data in accordance with a standard,such as a digital multimedia broadcasting (DMB), a digital videobroadcasting (DVB), a media Flo™, etc.

The elements described in the present disclosure may respectivelyconfigured as one or more components, and the name of each element mayvary depending on the type of an electronic apparatus. In variousembodiments, an electronic apparatus may be configured to include atleast one of the elements described in the present disclosure, and omitsome elements or further include another element. Also, some of theelements of an electronic apparatus according to various embodiments maybe combined to be a single entity to perform the same function of thecorresponding elements as the elements before combination.

FIG. 3 is a schematized flowchart of the present disclosure according tovarious embodiments of the present disclosure.

Referring to FIG. 3, the electronic apparatus 101 may analyze aplurality of pictures stored in the electronic apparatus 101 to identifya taste of the user and a brand of clothes worn by a user in thepicture. The electronic apparatus 101 may select a plurality of picturesstored in a memory based on a user preference, at operation 301. Thedetailed method of selecting pictures by the electronic apparatus 101will be provided later.

Once the pictures are selected, the electronic apparatus 101 or 201 mayanalyze the selected pictures and extract information on the backgroundsof the pictures and information on objects, typically clothes, includedin the pictures, at operation 302. The information on clothes may, asnon-limiting examples, be a brand name, color, size of the clothes, etc.The image of clothes included in the picture(s) may be an image of theclothes worn by the user or an image of the clothes worn by a differentperson or persons.

The background information and clothes information extracted by theelectronic apparatus 101 from the pictures may be stored in the memory130 or 230. For example, the electronic apparatus 101 or 201 mayrecognize that background information of a picture of the user whileclimbing a mountain is a “mountain”. Also, the electronic apparatus 101may extract a brand name of clothes worn by the user in the picture. Theelectronic apparatus 101 may include, in the picture, a backgroundextracted from the picture and a brand name of clothes worn by the userand store the same, or store it in the form of a separate data file.

As such, the electronic apparatus 101 may extract information of thepicture and the information on the clothes worn by the user from theselected picture, and transmit the selected picture, the backgroundinformation and the clothes information to the server 106, illustratedin FIG. 1.

The server 106 may determine a context of the received picture based oninformation on the picture and clothes provided by the electronicapparatus 101, and retrieve clothes information corresponding to thecontext and provide the information, or may synthesize the retrievedproduct image and the picture provided by the electronic apparatus 101to create a composite image and transmit the created composite image tothe electronic apparatus 101 or to the display apparatus 102 disposed ina position where the user is located, at operation 303. Alternatively,the electronic apparatus 101 may synthesize the transmitted productimage and the selected picture stored in the electronic apparatus 101 tocreate a composite image, and display the composite image on theelectronic apparatus 101.

FIG. 4 is a view illustrating a process of selecting a plurality ofpictures stored in the electronic apparatus 101 according to variousembodiments of the present disclosure.

Referring to FIG. 4, the electronic apparatus 101 may assign a weightedvalue to a picture stored in the memory 130, and select pictures basedon the weighted value. A “picture” in the present disclosure may referto “data to form a picture” or a “picture file”. For example, a picturestored in a memory may refer to “data to form a picture” displayed on adisplay.

The electronic apparatus 101 may assign a weighted value based on a dateand/or time on/at which a picture is taken. For example, the electronicapparatus 101 may assign a high weighed value to a more recently takenpicture, at operation 401.

The electronic apparatus 101 may analyze a captured picture, anddetermine a weighted value for the picture based on an orientation of anobject included in the picture. For example, the electronic apparatusmay, if the orientation of an object included in a picture is frontview, assign a higher weighted value, and if the orientation of theobject is side view or rear view, assign a lower weighted value, atoperation 402.

The electronic apparatus 101 may determine a weighted value for thepicture based on a user interaction detected while the display 160displays a captured picture. For example, in the state that a picture isdisplayed on the display 160, when the user performs a zoom-in gesture,as illustrated in FIG. 4, the electronic apparatus 101 may assign a highweighted value, at operation 403. When the user performs a zoom-ingesture while a picture is displayed on the display 160, the electronicapparatus 101 may determine that the user enlarged the picture out ofinterest, and increase a weighted value with respect to the picture. Onthe other hand, when the user performs a flick gesture while the pictureis displayed on the display 160, the electronic apparatus 101 maydetermine that the user is not interested the corresponding picture andchanges the picture, and reduce the weighted value.

The electronic apparatus 101 may determine a weighted value based onwhether a picture is shared or not. When the user shares a picture (e.g.when a picture is uploaded to a social networking site (SNS)), theelectronic apparatus 101 may set a high weighted value with respect tothe picture, at operation 404. For example, when the user depresses thebutton “share” while a picture is displayed on the display 160, theelectronic apparatus 101 may increase a weighted value of the picture.

When a picture is used as a profile or a background, the electronicapparatus 101 may set a high weighted value with respect to the picture,at operation 405.

The electronic apparatus 101 may determine a weighted value based onaccess information of the picture. When the user accesses the picture,the electronic apparatus 101 may store the access information of thepicture in the picture or picture file. The access information may beinformation on a date and/or time on which the user accessed thepicture. The electronic apparatus 101 may update access information ofthe picture every time the user accesses the picture. The electronicapparatus 101 may extract access information from the picture, and whenthe date/time of access is older than a predetermined date/time,recognize the picture as a neglected picture and set a low weightedvalue with respect to the picture, at operation 411.

When the user performs a flick gesture while a picture is displayed, theelectronic apparatus 101 may determine that the user has little or nointerest in the corresponding picture and changes the picture, and set alow weighted value for the corresponding picture, at operation 412.

The electronic apparatus 101 may determine a weighted value based oninformation on deletion of a picture. For example, the electronicapparatus 101 may recognize that a picture was taken by the user, andthen transmitted to a cloud server. Subsequently, when the picture isdeleted from the electronic apparatus 101, the electronic apparatus mayset a low weighted value with respect to the picture, at operation 413,and transmit information on a weighted value of the correspondingpicture to the cloud server.

FIG. 5 is a view illustrating a process of selecting, by the electronicapparatus 101, a picture received from the server 106 according tovarious embodiments of the present disclosure.

Referring to FIG. 5, the electronic apparatus 101 may assign a weightedvalue to a picture received from the server 106 (illustrated in FIG. 1),and select pictures based on the weighted value. In the case where theuser is surfing the web via a wired or wireless network 162, theelectronic apparatus 101 may receive pictures from the server 106. Forexample, when the user retrieves pictures through web surfing, theelectronic apparatus 101 may receive pictures from the correspondingserver.

The electronic apparatus 101 may determine a weighted value based onwhether a picture received from the server 106 was downloaded from theInternet. For example, when the user access an online shopping mall anddownloads a particular picture while retrieving a product, theelectronic apparatus 101 may set a high weighted value with respect tothe corresponding picture, at operation 501.

The electronic apparatus 101 may determine a weighted value based on ascreen capturing operation of the user. For example, when the usercaptures a particular picture while surfing the web, the electronicapparatus 101 may assign a high weighted value with respect to thecaptured picture, at operation 502.

The electronic apparatus 101 may detect a user interaction with respectto a picture received from the server 106, and determine a weightedvalue based on a user interaction. For example, in the case where theuser performs a zoom-in gesture with respect to a particular picturewhile surfing the web, the electronic apparatus 101 may set a highweighted value with respect to the corresponding picture, at operation503.

The electronic apparatus 101 may determine a weighted value based on atime at which a picture received from the server is displayed on ascreen. For example, when the user displays a picture on a screen for apredetermined time or longer while surfing the web, the electronicapparatus 101 may set a high weighted value with respect to thecorresponding picture, at operation 504, based on the screen gazingtime.

The electronic apparatus 101 may determine a weighted value with respectto a picture received from the server 106 based on whether the usershares the picture on SNS. For example, when the user clicks an SNSshare button while looking at a picture and surfing the web, theelectronic apparatus 101 may set a high weighted value with respect tothe corresponding picture, at operation 505.

The electronic apparatus 101 may detect a user interaction with respectto a picture received from the server 106, and determine a weightedvalue based on the user interaction. For example, as illustrated in FIG.5, in the state that the user is surfing the web, when the user clicks aback button while a picture is displayed on a screen, the electronicapparatus 101 may set a low weighted value with respect to thecorresponding feature, at operation 511. Alternatively, while surfingthe web, when the user performs a flick gesture with respect to apicture displayed on a screen and changes the picture to anotherpicture, the electronic apparatus 101 may set a low weighted value withrespect to the corresponding picture, at operation 512.

FIG. 6 is a flowchart of a process of assigning a weighted value to apicture created by a user according to various embodiments of thepresent disclosure.

Referring to FIG. 6, the electronic apparatus 101 reads a picture fromthe memory 130. The picture may have been stored in the memory 130 ofthe electronic apparatus 101 or in a cloud server, after being createdthrough a camera included in the electronic apparatus 101. Theelectronic apparatus 101 may determine whether the read picture wastaken recently, at operation S601. The electronic apparatus 101 mayextract date/time information from a picture, and compare the extracteddate/time information with a current date/time. As a result of thecomparison, if the picture was created before a predetermined date/time,“Yes” at operation S601, the electronic apparatus 101 may determine thatthe picture is a recent picture, and increase a weighted value of thepicture. If the picture was created after a predetermined date/time,“No” at operation S601, the electronic apparatus 101 may reduce ordecrease the weighted value of the picture, at operation S603.

The electronic apparatus 101 may analyze the read picture, and determinewhether an object included in the picture faces the front to determinewhether the picture is a front picture, at operation S604. If it isdetermined that the picture is a front picture, “Yes” in operation S604,the electronic apparatus 101 may increase a weighted value of thepicture, at operation S605. If it is determined that the picture is nota front picture, “No” in operation S604, the electronic apparatus mayreduce a weighted value of the picture, at operation S606.

Referring to FIG. 6, the electronic apparatus 101 may determine whetherthe read picture was shared recently, at operation S607. If it isdetermined that the picture was shared recently, “Yes” in operationS607, the electronic apparatus 101 may increase the weighted value ofthe picture, at operation S608. If it is determined that the picture wasnot shared recently, “No” in operation S607, the electronic apparatus101 may reduce the weighted value of the picture, at operation S609.When the user executes an SNS application to share a picture while thepicture is displayed on the screen, sharing information of thecorresponding picture may be stored in the picture. The sharinginformation may include a sharing date, time, and the name ofapplication executed to share the picture. The electronic apparatus 101may analyze sharing information included in the picture to determinewhether the corresponding picture has been shared.

The electronic apparatus 101 may detect a user interaction while thepicture is displayed on the display 160, and set a weighted value forthe picture based on the user interaction, at operation S610. Theelectronic apparatus 101 may display the picture on the display 160.When the user interaction is detected while the picture is displayed onthe display 160, the electronic apparatus 101 may identify the detectedinteraction, and store the identified result in the picture. Theelectronic apparatus 101 may read interaction information included inthe picture, and if the interaction information is a “zoom-in”, increasea weighted value of the picture, at operation S611. The electronicapparatus 101 may reduce the weighted value of the picture if theinteraction information included in the picture is a “swipe”, atoperation S612.

FIG. 7 is a flowchart of a process of assigning a weighted value to apicture received from the server 106 according to various embodiments ofthe present disclosure.

Referring to FIG. 7, in the case where the user is surfing the web via awired or wireless network 162, the electronic apparatus 101 may receivea webpage including a picture from the corresponding server 106. Forexample, when the user retrieves a picture through web surfing, theelectronic apparatus 101 may receive the picture from the correspondingserver 106. Also, if the user is provided with the photo from a selleror a vendor website via e-mail, the electronic apparatus 101 may receivethe picture from the corresponding server 106.

When the user access the Internet, the display 160 of the electronicapparatus 101 may display a webpage. The electronic apparatus 101 maydetermine whether the user downloads a picture while the webpage isdisplayed on the display 160, at operation S701. When the user downloadsa picture, “Yes” in operation S701, the electronic apparatus 101 mayapply picture selection criteria (for example, picture captured by theuser with his or her camera) created by the user to the downloadedpicture to select pictures, at operation S703. The detailed method ofselecting a user created picture is described with respect to FIG. 6 andthus the details thereof are omitted herein. If the user does notdownload a picture, “No” in operation S701, the electronic apparatus 101may determine whether the user captures a screen of a picture displayedon the display 160, at operation S702. If the user captures the screenof the picture, “Yes” in operation S702, the electronic apparatus 101may select the picture by applying picture selection criteria created bythe user to the picture, at operation S704. When the user does notcapture the screen of the picture, “No” in operation S702, theelectronic apparatus 101 may determine whether the corresponding picturewas shared recently, at operation S705. When the picture was not sharedrecently, “No” in operation S705, the electronic apparatus 101 mayreduce a weight value of the corresponding picture, at operation S707.When the picture was shared recently, “Yes” in operation S705, theelectronic apparatus 101 may increase the weighted value of thecorresponding picture, at operation S706.

The electronic apparatus 101 may detect a user interaction while thepicture is displayed on the display 160, at operation S708. If the userinteraction is a zoom-in gesture, the electronic apparatus 101 mayincrease a weighted value of the picture, at operation S709. If the userinteraction is a swipe gesture, a flick gesture or a back button, theelectronic apparatus 101 may reduce a weighted value of the picture, atoperation S710.

FIG. 8 is a view illustrating an example of extracting, from a selectedpicture, attribute information of clothes included in the picture andattribute information of a background of the picture according tovarious embodiments of the present disclosure.

Referring to FIG. 8, the present disclosure, as an example, only takesan example of clothes worn by a person, but other objects (e.g.accessories and wearable device) wearable by a person may be usedinstead of the clothes.

FIG. 8 illustrates pictures 801, 811, 821. The electronic apparatus 101may extract, from the pictures 801, 811, 821, various attributes ofclothes worn by an object (or person) included in the pictures 801, 811,821, and the attributes of the backgrounds of the pictures.

The attribute information on clothes may include a style, color, brand,size and other information of the clothes. For example, the styleattribute of clothes may include “dress shirt”, “formal suit”, “casual”,or etc. The size attribute of clothes may include “M”, “L”, “XL”, “XXL”and the like.

The attribute information of background may include a location of abackground of the picture, weather, season, context, or etc. Forexample, the background location attribute of the picture may include“mountain”, “beach”, “urban area”, etc. The weather attribute mayinclude “clear”, “cloudy”, “rainy”, “snowy”, etc. The weather attributemay include “spring”, “summer”, “autumn”, and “winter”. The contextattribute may include “drinking”, “wedding” “mountain climbing”,“exercising”, etc.

The electronic apparatus 101 may extract attribute information onclothes and background from a selected picture, and store attributeinformation in the memory 130 or the server 106 in a database form.Alternatively, the extracted attribute information may be stored alongwith the picture.

For example, the electronic apparatus 101 may extract the picture 801,and identify that the color of clothes worn by the identified user is“yellow” and that the style is “outdoor clothing”. The electronicapparatus 101 may extract the color as “yellow” and the style as“outdoor clothing” as attribute information of the clothes, and storethe extracted attribute information of clothes in the picture 801 orcreate the information in a separate file and store the file in theelectronic apparatus 101 or in the server 106. Also, the electronicapparatus 101 may analyze the picture 801, and identify a location ofbackground of the picture 801 as “mountain”, the weather as “clear”, andthe context as “mountain climbing”. The electronic apparatus 101 mayextract “mountain”, “clear” and “mountain climbing” as attributeinformation on background of the picture from the picture 801, and storethe extracted attribute information of the background in the picture 801or store the information in the electronic apparatus 101 or the server106 as a separate file.

The electronic apparatus 101 may analyze the picture 811, and identify acolor of clothes worn by the identified user as “white” and the style“wedding dress”, for example. The electronic apparatus may extract“white” for the color and “wedding dress” for the style as attributeinformation of clothes, and store the extract attribute information onclothes in the picture 811, or create a separate file and store the filein the electronic apparatus 101 or the server 106. Also, the electronicapparatus 101 may analyze the picture 811, and identify “outdoor” for alocation of background of the picture 811, “clear” for weather, and“wedding” for context. The electronic apparatus may extract, from thepicture 811, “outdoor”, “clear” and “wedding” for attribute informationon background of the picture, and store the extracted attributeinformation of the picture 811 in the picture 811, or create a separatefile and store the file in the electronic apparatus 101 or the server106.

The electronic apparatus 101 may analyze the picture 821, and identifythe color of clothes worn by the identified user as “blue”, the size as“M” (medium), and the style as “T-shirt”. The electronic apparatus 101may extract the color “blue” and the style “T-shirt” and the size “M”for attribute information of clothes, and store the extracted attributeinformation of clothes in the picture 821 or create a separate file andstore the file in the electronic apparatus 101 or the server 106. Also,the electronic apparatus 101 may analyze the picture 821, and identifythat a location of background of the picture 821 is the “beach”, thatthe weather is “clear”, and that the context is “traveling”. Theelectronic apparatus 101 may extract, from the picture 821, the locationof background as “outdoor”, the weather as “clear”, and the context as“traveling” as attribute information of the picture, and store theextracted background attribute information of the picture 821 in thepicture 821 or create a separate file and store the file in theelectronic apparatus 101 or in the server 106.

The electronic apparatus may combine the stored attribute information ofthe background and of the clothes to make a virtual table 831, anddetermine a brand, size, color, etc. of clothes preferred by the user.

FIGS. 9A and 9B are views illustrating an example of recommendingclothes preferred by a user by means of attribute information of apicture according to various embodiments of the present disclosure.

Referring to FIGS. 9A and 9B, FIGS. 9A and 9B illustrate a displayapparatus 901 exhibited in a store. The display apparatus 901 may, forexample, be a large flat display (LFD). When the user selects clothes inthe store and tags the clothes on the display apparatus 901, atoperation 903, the display apparatus 901 may display an image 902 of theclothes selected by the user (as illustrated in FIG. 9A).

Alternatively, an electronic apparatus 905 may advertise attributeinformation of clothes stored in a memory to the display apparatus 901,and the display apparatus 901 may receive attribute information of theadvertised clothes, retrieve clothes preferred by the user based on theattribute information of clothes, and display the image 902corresponding to the retrieved clothes.

Alternatively, the electronic apparatus 905 may transmit a pictureselected for fitting use stored in the electronic apparatus 905 to thedisplay apparatus 901 by means of a near field communication (forexample, NFC, WiFi), and the display apparatus 901 may synthesize theimage of clothes selected by the user with the transmitted picture forfitting use to create composite images, and display the createdcomposite images 906, 907 (as illustrated in FIG. 9B).

FIG. 10 is a view provided to explain an example of synthesizing aproduct image provided by a third party with a picture created by a userand providing the same according to various embodiments of the presentdisclosure.

FIG. 10 illustrates an electronic apparatus 1001, a cloud server 1002, apicture analysis server 1003, a display apparatus 1004, and anelectronic apparatus 1005. The electronic apparatus 1001 and theelectronic apparatus 1005 are the same type of electronic apparatus, forexample, a smartphone carried around by a user. The electronic apparatus1001 may determine a selected picture as a picture for fitting use basedon a weighted value. The picture for fitting use may store attributeinformation on clothes and background. The electronic apparatus 1001 maytransmit the selected picture for fitting use to the cloud server 1002.The picture for fitting use may automatically be transmitted to thecloud server 1002. The cloud server 1002 may store the picture forfitting use received from the electronic apparatus 1001. The cloudserver 1002 may transmit the picture for fitting use to the pictureanalysis server 1003. The picture analysis server 1003 may analyze thepicture for fitting use received from the cloud server 1002 anddetermine a context of the picture. The context of a picture may bedetermined by combining clothes included in the picture with anattribute of the picture. The picture analysis server 1003 may be aserver provided by a third party (for example, a seller of clothes).According to an embodiment, the cloud server 1002 may also serve as thepicture analysis server 1003. When a context of the picture for fittinguse is determined in the picture analysis server 1003, the pictureanalysis server 1003 may retrieve an image of clothes corresponding tothe context of the picture, and synthesize the picture for fitting usewith the retrieved image of clothes to create a composite image. Thepicture analysis server 1003 may transmit the composite image to thedisplay apparatus 1004 and the electronic apparatus 1005 of the user.The picture analysis server 1003 may transmit the composite image to thedisplay apparatus 1004 by a request of the display apparatus 1004. Whenthe user approaches near the display apparatus 1004, the displayapparatus 1004 may send a request for a composite image to the pictureanalysis server 1003, and display the composite image received from thepicture analysis server 1003 to be viewed by the user. Alternatively,the picture analysis server 1003 may transmit the composite image to theelectronic apparatus 1005 of the user based on position information ofthe user. The electronic apparatus 1005 may receive the composite imageand display the image on a display.

For example, when a user who has a smartphone enters a store of a thirdparty, the display apparatus 1004, illustrated in FIG. 10, may receiveinformation of the user advertised from the smartphone of the user viaBluetooth low energy (BLE), and identify the user. When the displayapparatus 1004 identifies the user, the display apparatus 1004 may senda request for a composite image corresponding to the user to the pictureanalysis server 1003, and receive the composite image to display it inthe display apparatus 1004 for the user. Alternatively, when the displayapparatus 1004 receives position information of the user and transmitsthe information to the picture analysis server 1003, the pictureanalysis server 1003 may transmit a composite image corresponding to theuser to the smartphone of the user. Alternatively, when it is determinedthat the picture analysis server 1003 receives position information fromthe smartphone 1005 of the user and that the user enters the store, thepicture analysis server 1003 may transmit a composite imagecorresponding to the user to the smartphone 1005 of the user.

FIG. 11 is a view provided to explain a process of synthesizing aproduct image with a picture for fitting use stored in an electronicapparatus according to various embodiments of the present disclosure.

Referring to FIG. 11, an electronic apparatus 1101 may determine aselected picture as a picture for fitting use based on a weighted value.The picture for fitting use may include attribute information of clothesand background. Alternatively, the attribute information of clothes andbackground may be stored in a memory in the form of a separate databasefile, and may be retrieved. The electronic apparatus 1101 may retrieve apicture for fitting use stored in the memory based on positioninformation of the user. For example, if the user is in an outdoorclothing store, the electronic apparatus 1101 may determine that thecurrent position of the user is in an outdoor clothing store based onposition information of the user, and retrieve a picture having outdoorclothing attribute from among pictures for fitting use stored in thememory.

The electronic apparatus 1101 may retrieve a picture for fitting usestored in the memory based on information on a current weather. Forexample, when the weather is clear, the electronic apparatus 1101 mayretrieve a picture having the attribute of “clear” from among thepictures for fitting use stored in the memory.

Referring to FIG. 11, the electronic apparatus 1101 may retrieve apicture for fitting use stored in the memory based on information on acurrent season. For example, if the weather is autumn, the electronicapparatus 1101 may retrieve a picture having the attribute of “autumn”from among the pictures for fitting use stored in the memory. Theelectronic apparatus 1101 may display the retrieved picture image 1102on a display.

If the user is at a store for outdoor clothing, the electronic apparatus1101 may receive advertisement content 1103 corresponding to the storebrand from the server. The advertisement content 1103 may, for example,be a product image. For example, if the user is at a store of “K brand”,the electronic apparatus 1101 may receive the advertisement content 1103of the “K brand” from the server.

When receiving the advertisement content 1103 from the server, theelectronic apparatus 1101 may synthesize the advertisement content 1103with the retrieved picture image 1102 to create a composite image 1105.For example, in operation 1106, if an object 1104 included in theretrieved image is wearing yellow outdoor clothes, the electronicapparatus 1101 may synthesize the advertisement content 1103 receivedfrom the server with the retrieved image, and change the object to theobject 1105 wearing a green outdoor clothes and create a compositeimage. The electronic apparatus 1101 may display the created compositeimage 1108 on the display.

The electronic apparatus 1101 may display the advertisement content 1109received from the server. For example, the electronic apparatus 1101 maydisplay the advertisement content 1109 as being overlapped with thecomposite image 1108 on the display. Alternatively, the electronicapparatus 1101 may separately display the advertisement content 1109 onthe display (e.g. display apparatus).

FIG. 12 is a flowchart provided to explain a process of synthesizing aproduct image with a picture for fitting use in an electronic apparatus,according to various embodiments of the present disclosure.

Referring to FIG. 12, an electronic apparatus 101 may first select apicture based on a weighted value, at operation S1201. The weightedvalue may be determined based on a date/time on which the picture wascreated. The electronic apparatus 101 may compare date/time informationincluded in the picture with today's date/time, when the date/time onwhich the picture was created is longer than a predetermined period, theelectronic apparatus 101 may determine that the picture is an oldpicture and reduce the weighted value of the picture, e.g., according tothe age of the picture.

The weighted value may be determined based on a shape of an objectincluded in the picture. The object included in the picture may be auser, and the shape of the object may be divided into a front side, alateral side, and a rear side. The electronic apparatus 101 may analyzethe picture and determine whether the shape of the object is a frontside, a lateral side or a rear side. The electronic apparatus 101 mayincrease the weighted value of the picture when it is determined thatthe shape of the object is a front side or lower the weighted value ofthe picture if it is determined that the shape of the object is alateral side or rear side.

The weighted value may be determined based on whether the picture is tobe shared. When the user shares the picture, sharing information may beincluded in the picture. The sharing information may include a sharingdate/time, a sharing address, and a name of an application used forsharing. The electronic apparatus 101 may extract sharing informationfrom the picture to determine whether to share the picture, and increasethe weighted value of the shared picture.

The weighted value of the picture may be determined based on a userinteraction. While the user creates a picture and then reproduces thepicture, when the user performs a zoom-in or zoom-out operation orflicks the picture, user interaction information may be stored in thepicture. The electronic apparatus 101 may extract the user interactioninformation from a picture stored in the memory 130 and determine aweighted value for the picture. A user interaction may be detected whilethe picture is being displayed on the screen. For example, when the userdisplays a picture on the screen to see the picture and performs azoom-in gesture, the electronic apparatus 101 may detect the userinteraction and store the detected user interaction in the picture. Ifthe user interaction is a zoom-in gesture, the weighted value of thepicture may be increased. The electronic apparatus 101 may first selectpictures of which the calculated weighted value is higher than or equalto a predetermined value using the method as above, and use the selectedpictures for fitting use. The various weighted values, such as a shapeof an object, whether the picture is to be shared, a user interaction,or other factors may be combined to create a total weight value for thepicture.

The electronic apparatus 101 may determine first attribute informationand second attribute information from the first selected pictures inoperation S1202. The first attribute information of a picture may beinformation on an object included in the picture. The object may be auser or clothes worn by the user. The electronic apparatus 101 mayanalyze the picture to identify the user, and extract a style, color,brand, size and other information of the clothes worn by the user. Forexample, the style attributes of clothes may, as non-limiting examples,include “dress shirt”, “formal suit” or “casual”. The size attributes ofclothes may, as non-limiting examples, include “M”, “L”, “XL” or “XXL”.The second attribute information of a picture may be information on thebackground of the picture. The background attribute information may, asnon-limiting examples, include a location of background, weather, seasonor context of the picture. For example, the background location of apicture may, as non-limiting examples, include “mountain”, “beach” or“downtown”. The weather attributes may, as non-limiting examples,include “clear”, “cloudy”, “raining” or “snowing”. The season attributesmay, as non-limiting examples, include “spring”, “summer”, “autumn” or“winter”. The context attributes may, as non-limiting examples, include“drinking”, “wedding”, “climbing a mountain”, or “exercising”.

The electronic apparatus 101 may store the first attribute informationand the second attribute information in the memory 130 in a databaseform, at operation S1203. The first attribute information and the secondattribute information is structured, categorized and stored, which isretrievable. Also, pictures having the same attributes may be retrievedand clustered.

The electronic apparatus 101 may second select at least one picture fromthe first selected pictures based on the first attribute information,the second attribute information and user context information, atoperation S1204. The user context information may include locationinformation of a user. Also, the user context information may includeinformation on an operational state of the user. For example, thecontext information may indicate whether the user is shopping, sleeping,going to work or eating.

The electronic apparatus 101 may receive a product image correspondingto the second selected picture from the server 106, at operation S1205.The second selected picture may be used to create a composite image.

The product image may, for example, be an image of clothes provided by athird party. The product image may be selected based on information on apicture for fitting use provided by the electronic apparatus 101. Theelectronic apparatus 101 may, when the user is in a particular locationor performs a particular action, select a picture for fitting usecorresponding to a user's context, and provide attribute information ofthe picture for fitting use to the server 106 or to the displayapparatus 102.

In operation S1206, the electronic apparatus 101 may synthesize thesecond selected picture and the product image to create a compositeimage. The operation of generating a composite image may be performed inthe electronic apparatus 101, in the server 106, or in the displayapparatus 102.

The electronic apparatus 101 may display the created composite image inthe electronic apparatus. In addition, the created composite image maybe displayed in the display apparatus 102.

While the present disclosure has been shown and described with referenceto various embodiments thereof, it will be understood by those skilledin the art that various changes in form and details may be made thereinwithout departing from the spirit and scope of the present disclosure asdefined by the appended claims and their equivalents.

What is claimed is:
 1. A method for generating a composite image of an electronic apparatus, the method comprising: first selecting at least one picture based on a weighted value; determining first attribute information and second attribute information based on the first selected at least one picture; storing the first attribute information and the second attribute information in a database form; second selecting at least one picture from among the first selected at least one picture based on the first attribute information, the second attribute information and user context information; receiving a product image corresponding to the second selected at least one picture from a server; and generating a composite image by synthesizing the second selected at least one picture with the product image.
 2. The method as claimed in claim 1, wherein the weighted value is determined based on when a picture among the plurality of pictures is created.
 3. The method as claimed in claim 1, wherein the weighted value is determined based on a shape of an object included in a picture.
 4. The method as claimed in claim 1, wherein the weighted value is determined based on whether a picture is shared.
 5. The method as claimed in claim 1, wherein the weighted value is determined based on a user interaction.
 6. The method as claimed in claim 5, wherein the user interaction is detected while a picture is displayed on a screen.
 7. The method as claimed in claim 6, wherein the weighted value is increased in response to the user interaction being a zoom-in gesture.
 8. The method as claimed in claim 1, wherein the first attribute information comprises information on an object included in a picture.
 9. The method as claimed in claim 1, wherein the second attribute information comprises information on a background of a picture.
 10. The method as claimed in claim 1, wherein the user text information includes position information of a user.
 11. An apparatus for generating a composite image, the apparatus comprising: a memory configured to store a plurality of pictures; a transceiver configured to communicate with an external server; a display configured to detect a user interaction; and a processor configured to: read the plurality of pictures from the memory, first select at least one picture based on a weighted value, determine first attribute information and second attribute information from the first selected at least one picture, store the first attribute information and the second attribute information in a database form, and second select at least one picture from among the first selected at least one picture based on the first attribute information, the second attribute information and user context information, control the transceiver to receive a product image corresponding to the second selected picture from the external server, and create a composite image by synthesizing the second selected at least one picture and the product image.
 12. The apparatus as claimed in claim 11, wherein the weighted value is determined based on when a picture among the plurality of pictures is created.
 13. The apparatus as claimed in claim 11, wherein the weighted value is determined based on a shape of an object included in a picture.
 14. The apparatus as claimed in claim 11, wherein the weighted value is determined based on whether a picture is shared.
 15. The apparatus as claimed in claim 11, wherein the weighted value is determined based on a user interaction.
 16. The apparatus as claimed in claim 15, wherein the user interaction is detected while a picture is displayed on a screen.
 17. The apparatus as claimed in claim 16, wherein the weighted value is increased in response to the user interaction being a zoom-in gesture.
 18. The apparatus as claimed in claim 11, wherein the first attribute information comprises information on an object included in a picture.
 19. The apparatus as claimed in claim 11, wherein the second attribute information comprises information on a background of a picture.
 20. The apparatus as claimed in claim 11, wherein the user context information includes position information of a user. 